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ABSTRACT 

The  problem  of  aiming  control,  introduced  in  [1],  is  extended  to  systems  with 
outputs.  Necessary  and  sufficient  conditions  for  output  residence  time  controllability 
in  linear  SISO  systems  with  small,  additive  noise  are  derived.  Controller  design  tech¬ 
niques  are  developed  and  applied  to  aircraft  and  robotics  control  problems.  The 
approach  is  based  on  an  extension  of  the  asymptotic  first  passage  time  theory  to  output 
processes. 
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Given  a  controlled  dynamical  system  with  states  x{t)  €  IR  ,  control 
u(t)  e  IR  m  .  output  y(r)  e  IR  p  and  disturbances  %(r)  e  Z7?  r  ,  we  define  the  out¬ 


put  aiming  process  specifications  as  a  pair  where  'F cZR  p  is  the  domain  to 

which  the  outputs  y(t)  should  be  confined  and  x  is  the  period  of  the  confinement,  i.e., 
y  (t  )€  *F,  V  t €  [t0  ,ta  +  tj,  ta€  IR*  . 

For  a  given  pair  { *F,t ) ,  the  problem  of  output  aiming  control  is  formulated  as  the 
problem  of  choosing  a  feedback  control  law  so  as  to  force  the  average  duration  of  y(f) 
in  'F  to  be  larger  than  t,  in  spite  of  the  disturbances  q(r )  that  are  acting  on  the  system. 

An  analogous  problem,  concerning  the  aiming  of  the  states  x(t ),  rather  than  the 
outputs  v(/),  has  been  formulated  and  analyzed  in  [1].  In  particular,  it  has  been 
shown  that  the  existence  of  a  desired  aiming  controller  for  linear  systems  with  small 
additive,  white  noise  depends  on  the  relationship  between  the  column  spaces  of  the 
control  and  noise  matrices.  If  the  former  includes  the  latter,  any  precision  of  aiming  is 
possible  (strong  residence  time  controllability).  If  this  inclusion  does  not  occur,  the 
achievable  precision  of  aiming  is  bounded  (weak  residence  time  controllability). 

The  purpose  of  the  present  paper  is  to  analyze  the  fundamental  capabilities  and 
limitations  of  output  aiming  control  for  linear  systems  with  additive  perturbations. 
Specifically,  we  show  that  a  linear  SISO  system  which  is  weakly  residence  time  con¬ 
trollable  in  states  may,  in  fact,  be  strongly  residence  time  controllable  in  the  output  if 
its  nonminimum  phase  zeros  satisfy  a  certain  property.  As  far  as  the  design  of  aiming 
controllers  is  concerned,  we  show  that  //^minimization  of  the  closed  loop  transfer 


function  leads  to  maximization  of  the  accuracy  of  output  aiming  whereas  unweighted 
/f  "-minimization  leads  to  its  minimization. 

The  structure  of  the  paper  is  as  follows:  in  Section  2  the  notion  of  an  output 
residence  time  is  introduced;  in  Section  3  output  residence  time  controllability  is 
defined  and  analyzed;  in  Section  4  output  aiming  controller  design  techniques  are 
given;  in  Section  5  examples  are  considered  and  Section  6  is  devoted  to  conclusions. 
The  proofs  are  given  in  the  Appendix. 

2.  OUTPUT  RESIDENCE  TIME 
Consider  a  linear  stochastic  system 

dx  ~  Axdt  +  eCdw 

(2.1) 

y  =  Dx 

where  x  €  IR  ”,  y  e  IR  P  ,w(r)  is  a  standard  r  -dimensional  Brownian  motion  and 
()<£<?:  1  is  a  parameter. 

Let  'Fc/R  p  be  an  open  bounded  domain  containing  the  origin  and  whose  boun¬ 
dary  dT  is  smooth.  Assume  that  Xq=x  (0)  e  Of)={x€  IR"  I y=Dx  e  *P}  and  denote  as 
y  (r  jc0)  the  output  y(t )  defined  by  (2.1)  with  the  initial  condition  x0.  Introduce  the 
first  passage  time  of  the  output  y  (t  rx0)  from  ¥  as  follows: 

teUo>siiif{r20:3r(rvxo)  e  3'Fly(r(>x0)  €  *F)  (2.2) 

and  its  mean 


Te  (.v 0)  =  E[x  e(x0)lx0]  • 


(2.3) 


The  calculation  of  te  (.t0)  is,  in  general,  a  difficult  task.  To  alleviate  this 
difficulty,  asymptotic  approximations  with  respect  to  small  £  can  be  used.  For  the  spe¬ 
cial  case  v  (t  )=x  ( t )  these  approximations  have  been  extensively  discussed  in  the  litera¬ 
ture  (see,  e.g.,  [1]  -  [3]  and  references  therein).  An  extension  to  the  more  general  case 
of  v  (r )  =  Dx  ( t )  is  given  below  (it  is  assumed,  without  loss  of  generality,  that  rank 
D  =  p). 

Theorem  2.1:  Assume 

(i)  A  is  Hurwitz, 

(ii)  (A  ,C )  is  completely  disturbable,  i.e., 
rank  [C  AC  An~lC)  =  n. 

Then  uniformly  for  all  x0  belonging  to  compact  subsets  of 
£2  =  {.t0  €  ZR  n  \DeAt xQ  e  4*,  r>0}  we  have 

lim  e2  In  x e  (.t0)  =  (l('F)  ,  (2  4) 

e— >0  v 

where 

ji('F)=  min  ~  yTNy  ,  (2.5a) 

y  €  err  L 

N=(DXDTrl  (2.5b) 

and  X  is  the  positive  definite  solution  of 

AX  +  XAT  +CCt  =0  .  (2.5c) 

Proof:  See  the  Appendix. 

The  constant  |1(VP)  is  referred  to  as  the  logarithmic  residence  time  in  VP.  The  pro¬ 
perties  of  this  constant,  as  stated  in  Theorem  2.1,  constitute  the  mathematical  founda- 


tion  for  the  analysis  in  Sections  3  and  4. 


If  y  and  w  are  scalars,  the  logarithmic  residence  time  can  be  expressed  in  a  more 
traditional  form.  Indeed,  since  in  this  case  SK  is  an  interval,  say, 

'P  =  (-« a  ,b ),  a  ,b  >0,  and  Gn(s)  =  D(sl  -A  )_1  C  is  a  scalar,  from  (2.5)  it  follows  that 


M-('P)  =  ~2  (min (a,b))2N, 


* 

oo 

-l 

w  * 

OO 

N  = 

\  DeA,CCTeATlDTdt 

0 

-  > 

— 

j  (DeAlC)2dt 

0 

•  - 

oo 


\D(J(i}I  -  A)  lC  I  dw 


-l 


IIGnll2-2 


Therefore, 


M-('P)  = 


(min(a  ,b  ))2 
2IIG„  1 1 2 


(2.6) 


3.  OUTPUT  RESIDENCE  TIME  CONTROLLABILITY 


Consider  now  a  controlled  linear  stochastic  system 

dx  =  (Ax  +  Bu  )dt  +  eCdw  ,  u  e  IR  m 

n  (3.D 

y  =Dx  . 

Definition:  (i)  The  output  y(t)  of  system  (3.1)  is  said  to  be  weakly  residence 
time  controllable  (y-wrt  controllable)  if  for  any  bounded  domain  vFcZ7?  P  with  0  in 
its  interior,  there  exists  a  control  u  =  Kx  such  that  |i(vF^)  >  0. 

(ii)  y(r)  is  said  to  be  strongly  residence  time  controllable  (y-srt  controllable)  if 
for  any  bounded  ¥  c  ZR  P  (0  e  TO  and  p>0  there  exists  u  =  Kx  such  that 
p('PiT)>p. 


Here,  fic'F.AT )  is  the  precision  of  aiming  in  4/, 


=  lim  e2ln  t 6  U0^)  ,  (3  2) 

e— >0  v  ' 

where  Te  (x0JC)  is  the  mean  first  passage  time  in  NP  of  the  closed  loop  system 

dx  =  (A  +  BK  )xdt  +  zCdw 

(33) 

y  =Dx  , 

with  initial  conditions  x0  =  .t(0)  e  =  [x  e  IR"  I De(A  +BK'>'x  e  VF,  r>0}. 

In  [1]  we  have  discussed  wrt-  and  srt -controllability  of  the  state  vector  x(t),  i.e., 
.r  -wrt  and  x  -srt  controllability.  The  main  result  is  the  following: 

Theorem  3.1:  Assume  (3.1)  has  no  modes  that  are  both  uncontrollable  and 
undisturbable.  Then 

(i)  (3.1)  is  a: -wrt  controllable  if  and  only  if  (A,  B )  is  stabilizable. 

(ii)  (3.1)  is  a: -srt  controllable  if  and  only  if  (A,  B)  is  stabilizable  and 
ImC  £  Im5 . 

Remark  3.1:  The  assumption  that  (3.1)  has  no  modes  that  are  both  uncontroll¬ 
able  and  undisturbable,  i.e.  {A  ,[B  C])  is  a  controllable  pair,  is  made  to  rule  out  some 
mathematical  degeneracies.  Methods  for  relaxing  this  assumption  are  discussed  in  [1]. 

The  following  theorem  characterizes  the  class  of  y  -wrt  controllable  systems. 


Theorem  3.2:  Assume  that  (A,[fl  C])  is  controllable.  Then  (3.1)  is  y-wrt  con¬ 
trollable  if  (A  R )  is  stabilizable.  If  (D  A  )  is  detectable  then  stabilizability  of  (A  Ji )  is 
also  a  necessary  condition  for  y  -wrt  controllability. 


.  .  t  *  -  i  * 


Proof:  See  the  Appendix. 

Thus,  y-wrt  controllability  of  a  detectable  output  is  equivalent  to  ,r-wrt  controlla¬ 
bility.  Finding  conditions  which  ensure  y-srt  controllability  is  a  more  difficult  prob¬ 
lem.  To  simplify  the  situation,  in  the  remainder  of  the  paper  we  assume  that  y  ,u  and 
w  are  scalars  and  address  the  following  problems: 

Problem  I:  Under  which  conditions  is  a  stabilizable  system  (3.1)  y-srt  controll¬ 
able? 

Problem  2:  What  is  the  fundamental  bound  on  the  achievable  precision  of  out¬ 
put  aiming  of  an  output  which  is  not  y  -srt  controllable? 

Problem  3:  How  to  design  a  controller  which  results  in  a  desired  precision  of 
output  aiming? 

We  give  the  solutions  to  Problems  1  and  2  in  this  Section  and  to  Problem  3  in 
Section  4.  The  assumption  of  Theorem  3.2  will  be  assumed  to  hold  in  the  remainder 
of  the  paper. 

The  following  theorem  solves  Problem  1. 

Theorem  3.3:  Assume  (AM)  is  stabilizable.  Then  (3.1)  is  y-srt  controllable  if 

and  only  if  all  the  nonminimum  phase  zeros  of  Gs(s)  =  D  (si  -  A  )~lB  are  also  zeros 
of  G„(s)  =  D(sI  -  A  r'C. 

Proof:  See  the  Appendix 

Remark  3.2:  If  the  open  right  half  plane  zeros  of  Gs  (s )  and  Gn  (s )  are  disjoint, 
then  (3.1)  is  y-srt  controllable  if  and  only  if  Gs(s)  is  minimum  phase.  On  the  other 


^  |*|  |A«  I 


ii 


hand,  if  (3.1)  is  v-srt  controllable,  i.e.  Im  C  c  Im  fi,  then  Gn(s)  is  proportional  to 
Gs(s )  and,  therefore,  by  Theorem  3.3  any  output  is  y-srt  controllable. 

Let  K  denote  the  class  of  all  stabilizing  controllers  for  systems  (3.1),  i.e. 

K  =  { AT  I A  +  BK  is  Hurwitz} 

and  define  the  maximum  achievable  precision  of  aiming  in  T  by 

sup  ierjo  .  (3.4) 

Obviously,  (i.*  (HP)  =  <»  for  an  srt-controllable  output.  Let  z  1(  •  •  ,z/  be  the  open  right 

half  plane  (rhp)  zeros  of  Gs(s). 

Theorem  3.4:  Assume  (AJ3)  is  stabilizable.  Then  n*0F)  is  given  by 


»,«,x  _  (min(a  ,b  )f 


\i  (¥)  = 


2\\G0\\j 


G0(s )  =  -  I”’  , 

hiTi+s)  (3‘6) 

i  =  1 

where  Tt  is  the  complex  conjugate  of  z,  and  q(s)  is  the  unique  polynomial  of  degree 
less  than  /  determined  by  the  interpolation  constraints:  At  each  rph  zero  z  of  Gs(s)  of 
multiplicity  m,  G0(s )  satisfies 

—  G0(5)  U  =  ~k  Gn{s)  U,  *=  0,  -  jn-l.  (3.7) 

ds  ds 

Proof:  See  the  Appendix 

Remark  3.3:  If  (3.1)  is  y-srt  controllable  then  the  interpolation  constraints 
(3.7)  become 


—  G0(s)  U  =0  •*  =° . «  "  1  ■ 

dsk 

The  unique  polynomial  q{s)  of  degree  less  than  l  which  satisfies  these  constraints  is 
the  zero  polynomial.  Therefore,  Gq(s  )  =  0  as  should  be  expected. 

Remark  3.4:  The  function  G0(s)  defined  by  (3.6)  is  the  rational  function  of 
minimum  H2- norm  which  satisfies  the  interpolation  constraints  (3.7)  [4],  [5].  Thus, 
the  problem  (3.4)  is  equivalent  to  the  problem 

min{  II G  1 1 2  :  G(s )  €  H  2,  G  ( s )  rational } 


subject  to  the  constraints  (3.7).  On  the  other  hand,  the  //“-optimal  function  which 
satisfies  the  interpolation  constraints  (3.7)  is  an  all  pass  function,  i.e.,  constant  in  mag¬ 
nitude  on  the  j co-axis.  Thus,  an  unweighted  //“-optimal  controller  leads  to  zero  preci¬ 
sion  of  aiming. 

The  formula  (3.5)  for  p*('F)  simplifies  considerably  when  the  rhp  zeros  of  Gs  (s) 
are  distinct.  Define  an  Ixl  matrix  Z  by  =  (z,  +  z;)-1,l</,y</,  and  an  /xl  column 
vector  g  by  gj  =  G„(z;  ),j  =  1,  •  •  •  ,/. 


Theorem  3.5:  Assume  that  the  rhp  zeroes  of  Gs  (s)  are  all  distinct.  Then 

.(4,)=  (mmla  ,b))2 

2  gHZ~xg 

where  gH  is  the  Hermitian  transpose  of  g  ,  i.e.  gH  =  gT . 

Proof:  See  the  Appendix 
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4.  OUTPUT  AIMING  CONTROLLER  DESIGN 
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In  this  section  we  give  a  method  for  selecting  a  controller  which  results  in  any 
admissible  precision  of  aiming  p  <  j 

Recall  that  |i(vt/,Af)  is  given  by 


.V 


1 


\iCVJ()  =  -^mn(aJ}))2N(K)  . 

Thus,  the  maximization  problem  (3.4)  is  equivalent  to  the  minimization  problem 


(4.1) 


t 


c. 


inf  DX(K)Dt 

K  e  K 


(4.2) 


Since  the  equation  which  X{K)  satisfies  is  linear  in  AT,  it  is  easy  to  see  that  the 
infimum  (4.2)  is  not  attained  at  any  K  e  K.  Thus,  p*  (VF)  is  not  attained  for  any 
AT  e  K.  We  now  construct  a  sequence  of  controllers  whose  precisions  of  aiming  con¬ 
verge  to  p*('F).  Let  K0  be  a  stabilizing  feedback  for  (3.1)  and  define  a  regularized 


“cost’ 


J^K)  =  DX  (K0+K  )D 1  +y£X  (K0  +K  )KT  ,y>0  . 


(4.3) 


Obviously, 


,N 


V 

u 


AWo  +  K)>  X  s  K  (4.4) 

It  is  well  known  from  the  theory  of  optimal  control  that  J^K)  is  minimized  by 

r,=  --‘sreT  (4.5) 

where  Qy  is  the  positive  semi-definite  solution  of 

iA+BK{))TQy+Q^A+BK0}+DTD-^QyBBTQy  =  0  .  (4.6) 


r 


The  following  Theorem  can  be  proved  using  the  results  of  [6]. 

Theorem  4.1:  Assume  (A  B  )  is  stabilizable.  Then 

(i)  lim  (1(4',  K0  +  K't)  =  (I*  (VP)  ; 

f— »o 

(ii)  |1(VP,  K o  +  K 'O  is  nondecreasing  as  y— >0. 

Thus,  Theorem  4.1  provides  an  iterative  method  for  finding  a  controller  which 
results  in  any  admissible  precision  of  aiming.  Indeed,  for  any  desired  ji  <  jj.*  (4*)  one 
simply  iteratively  finds  a  yj  >  0  such  that 

DX(K0  +  Ky')DT  <  -mm-a  . 

2p. 

Furthermore,  the  iterative  process  is  simplified  by  the  monotonicity  of  jX(vP,  K0  +  K'() 
in  Y- 


5.  EXAMPLES 


Example  5.1:  In  [1]  we  considered  the  problem  of  designing  a  roll  attitude 
regulator  for  a  missle  disturbed  by  random  torques.  The  system  is  described  by 
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0 

CO 

= 

10 

-l 
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CO 
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0 

u  +  £ 

1 
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.0 

1 

0 

UJ 

p. 

0. 

(5.1) 


where  5  is  the  aileron  deflection,  to  is  the  roll  angular  velocity,  <$>  is  the  roll  angle,  u  is 
a  command  signal  to  aileron  actuators  and  w  is  white  noise. 

Clearly  ImC  <£Im£  so  (5.1)  is  not  x  -srt  controllable.  However,  as  was  indicated 


in  [7]  the  main  objective  of  the  control  is  to  maintain  the  roll  angle  <{>  within  desired 
limits  during  the  operation  of  the  missle.  Thus  we  choose  an  output  y  =  (j>  and 


investigate  the  residence  time  controllability  of  this  output.  A  simple  calculation 
shows  that  the  transfer  function  from  u  to  v  is 


Gs(s)  = 


10 


s~(s  +  1) 

Thus,  since  Gs  (5 )  has  no  zeros  the  output  v  is  srt-controllable  and  any  precision  of 
aiming  is  achievable. 

Example  5.2:  Consider  the  problem  of  controlling  the  tip  position  of  a  flexible 
robot  arm  using  control  torques  applied  at  the  robot  arms  hub  [8].  A  finite  dimen¬ 
sional  approximate  model  for  a  robot  arm  which  is  flexible  in  the  horizontal  plane  but 
not  in  the  vertical  plane  or  in  torsion  was  described  in  [8].  The  model  is  described  by 
the  following  set  of  equations 


’  0  l 

0 

U 

r,  = 

-<o,2  -2^(0, 

Xi  + 

1 

~  ~T  (0) 

+ 

0 

/p  dz 

(5.3) 


y,  =  [4>, (L )  0]a,  ,  /  =  0,  1,  .  .  .  ,n  , 

where  L  is  the  length  of  the  arm,  ^  ,(0,  and  (z )  (z  €  [0 JL  ])  are  the  damping 
coefficient,  pinned-firee  frequency  and  modal  gain,  respectively,  of  the  /  -th  mode  of 
oscillation,  IT  is  the  total  moment  of  inertia,  u  is  the  control  torque,  ^  is  a  random 


torque  acting  on  the  tip,  and  y  =  £  y;  is  the  tip  position. 

i  =0 

Assume  that  it  is  desired  to  maintain  the  tip  position  within  the  bounds  -a£y£b 
during  a  specified  time-interval  T ,  and  assume  that  the  disturbance  ^  can  be  modelled 
as  a  small  white  noise  Ew . 


II 


The  system  transfer  function  for  (5.3)  is 


Gs{s) 


di MO) 

M L) — 

S2  +  2£,  (0,5  +  CO,2 


(5.4) 


and  the  noise  transfer  function  is 


Gn  ( s ) 


£  4>,2(L  )(g  +  2£,co,) 

,  =  0  s2  +  2 ^(O'S  +  cof 


(5.5) 


It  was  indicated  in  [8]  that  taking  n  =  3  gives  a  good  approximate  model  and  the 


values  of  the  constants  £,•  ,co,  ,0,  (L  ),d (j>,  (0)/dz  and  IT  were  determined  experimentally. 


The  resulting  system  has  three  right  half  plane  zeroes  at  zt  =  12.04  and 
j 2.3  =  21.5  ±  j  25.3.  It  is  easily  checked  that  Gn(z  *  0.  Thus  system  (5.3)  is  not 
y-srt  controllable.  However,  it  is  controllable  and,  thus,  y-wrt  controllable  and  the 
maximal  achievable  precision  of  aiming  can  be  obtained  from  (3.8)  to  be 


nw  = 

2 gHZ  lg 
_  (min(a  ,b  ))2 
2(0.046) 


10.87(min(a  ,b))2. 


(5.6) 


Here, 


Z-1= 


0.167  -0.01 4~;  0.1 36 

-0.049+/' 0.1 36  74.178 

rO.049-;0.136  -3 1.1 50-;  38.462 


-0.049+;0.136 

-31.150+y38.462 

74.178 


and 


g  = 


0.181 

0.092  -  70.057 
.0.092  +  70.057. 


Thus,  any  specified  time-interval  [0,7]  has  to  satisfy  the  bound 


InT  < 


10.87(min(a  ,b  ))2 


(5.7) 


i 

* 


r  ' 


u 


i 


£~ 


6.  CONCLUSIONS 


In  this  paper  we  have  discussed  the  problem  of  aiming  control,  introduced  in  [1], 
for  linear  Ito-rype  systems  with  outputs.  Among  the  results,  the  following  are  of 
importance: 

(a  )  y  -wrt  controllability  of  any  detectable  output  is  equivalent  to  x  -wrt  controlla¬ 
bility; 

(b)  A  stabilizable  SISO  system  is  y-srt  controllable  if  and  only  if 
H (s  )  =  Gs(s  )G~\s )  is  minimum  phase; 

(c)  A  system  which  is  not  x-sn  controllable  can  be  y-srt  controllable. 

The  v  -srt  controllability  was  discussed  only  for  systems  with  scalar  outputs.  The 
results  can  be  extended  to  multivariable  systems  with  fewer  outputs  than  inputs  in  a 
quite  straightforward  way.  However,  all  proofs  become  considerably  more  involved. 
For  systems  with  fewer  inputs  that  outputs  the  problem  is  much  more  difficult  and 
results  are  only  known  for  the  special  case  y  =  x . 


s* 

$ 
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APPENDIX 


Proof  of  Theorem  2.1:  First  note  that  it  follows  from  the  definition  of  £20  that 


inf{r>OI_v(/)  e  3'P>  =  inf [ r  >  0 1 .r (/ )  €  d£20}  .  (A.l) 

We  will  show  that  the  first  exit  of  x  (r)  from  £2  takes  place  on  the  boundary  of  £2^ 
Thus,  for  t0  =  ,t(0)  e  £2  the  first  exit  of  y  (t )  from  4*  is  equivalent  to  the  first  exit  of 
x(t )  from  £2.  Then  we  will  show  that  the  logarithmic  residence  time  in  £2  (and,  thus, 
in  4/)  is  given  by  (2.5). 

Let  X  be  the  positive  definite  solution  of  (2.5c)  and  let  M  =  X-1.  Consider  the 

sets 


Sm  =  (jc  €  ZR"  \  -^xTMx<m  }  .  (A.2) 

For  sufficiently  small  m ,  Sm  c  Qq.  Furthermore,  Sm  —tIR"  as  m  --»«>.  Thus,  there 
exists  a  largest  m  such  that  c:  £2q.  Note  that  is  an  invariant  set  of  the  system 
x  =  Ax .  Furthermore,  Cl  is  the  largest  invariant  set  of  x  =  Ax  contained  in  CIq. 
Therefore,  S ^  <=  £2.  Next  note  that  the  mean  first  passage  time 


of 


tje(.t0)  =  £[inf(r  >  Ol.v(r)  e  9£2)  lx0  e  £2] 


dx  =  Axdt  +  eCdw 

from  £2  satisfies,  uniformly  for  x0  belonging  to  compact  subsets  of  £2  [1], 


lim  e2  lnt^Crn)  =  4>(£2)  =  min  xT  Mx  . 
e— *0  tedQ  2 


(A.3) 


1  T 

Since  m  is  the  largest  m  such  that  Smc£2o  it  follows  that  -  x1  Mx  =  m  at  some 


points  a  €  dQ0.  Furthermore,  since  S(-  cOc^  it  follows  that  these  points  also 
belong  to  the  boundary  of  Q.  It  follows  from  (A. 3)  that  <j >(Q)<m  .  If  §{Q)<m  then  the 
pornts  where  the  minimum  (A. 3)  is  attained  belong  to  the  interior  of  5^  which  con¬ 
tradicts  Sm  c;  Q.  Therefore,  =  m  and  the  points  where  the  minimum  (A. 3)  is 
attained  belong  to  the  boundary  of  Qq.  Also,  as  £  — »  0  the  points  of  exit  of  x{t)  from 
Q  converge  to  the  points  where  the  minimum  (A. 3)  is  attained  [9].  Therefore,  it  fol¬ 
lows  that  a  (r )  exits  at  a  boundary  point  of  Q0  in  the  limit  £— >0.  Thus  from  (A.  1 ) 
and  the  above  discussion  we  have 


=  T~xATxdt  +  eT~lCdw 


^ll  ^12  *1  .  ,  e  Q 

7  1  -  dt  +£  p  dw 


^21  ^22  \x2 


y  =  DTx  =  Dx=  [I  0]  - 

x2 


m 


(such  a  T  always  exists  because  rank  D  =p ).  Under  this  change  of  coordinates  M  is 
mapped  into  M  =  Tt  MT  and  the  domains  £2q  and  £1  become 


Q0=  {*€  nr  Iaj  €  'F) 


m 
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Q=  [xqgIR"  I  v  =  De*.xo  e  VF,  r  >0} 
The  logarithmic  residence  time  in  £2  (and  £20)  is  now  given  by 


1  ~r  -  ~ 

0(£2)  =  min  -  ,r  M  x 

xe  ario  2 

=  .min  -  [x{  x{  ] 
X,  6dt  2 
x1  free 


Ml  %2 

fi 

Ml i  M22 

x2 

We  minimize  first  with  respect  to  the  unconstrained  variables  x2  giving 


-*2  ~  ~^22  M\2  vi 
Substituting  (A. 7)  into  (A. 6)  and  rearranging  gives 


*  -  1  -  -  ,  -r  - 
4>(Q)  =  min  -  .t[[A/u  -  Ml2  M22  M{2]Xy 
i|€  dV  2 

The  matrix  Mlx  -Ml2  M22  Mj2  is  exactly  X^x  where 


*12 

X~22 


Therefore, 


0<£2 )  =  min  -  xT  X[x  . 

i.  e  d*  2 

However,  ,V1  (  =  DXL?  and  ther.  tore 

4KQ)=  rrun  -*  x{  (DXE?  )~lx, 

€  W  2 

Finally,  substituting  back  the  original  coordinates  gives  D  X  E? 
=  DTT~1X(Tt)-[  TtDt  =  DXDt  Thus 


(A.6) 


(A.7) 


(A. 8) 


(A.9) 


(A.10) 


Q.E.D. 


i(£2)  =  (l('P)  =  ~2 


min  -  vT Nx 
yeW  2  ' 


(A.ll) 
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Proof  of  Theorem  3.2:  The  sufficiency  part  of  the  theorem  follows  directly 


fr^m  Theorem  3.L  of  [1], 

To  prove  the  necessity  note  that  y-wrt  controllability  implies  that  there  exists  a 
control  u  =  Kx  such  that  DX(K)DT  >  0.  Assume,  without  loss  of  generality,  that 
the  closed  loop  system  has  the  Kalman  canonic  form,  i.e.. 


A  +  BK  =  A  = 


■ 

Al 

0 

^13 

An 

A22 

a23 

0 

0 

a33 

0  0  A*3  \ 4 


(A.12) 


The  subsystem 


C  =  r~  ,  D  =  [D  i  0  D  3  0] 

3 

Q 


*n  0  1  [fi.l 

^  ,  g  is  controllable  and  the  detectability  of  (DA) 


implies  that  Aw  is  Hurwitz.  If  we  can  show  that  A33  is  Hurwitz  the  proof  is  com¬ 
plete. 

Note  that 


j-  An  X  i3  D  ]"  «»»_ 

DX(K  )Dt  =  [D  [D31  "  ‘3  l  =  DXDT 

•  lx |3  a33  d\, 


(A.13) 


where  Xtj  ,  1<; <4,  is  a  decomposition  of  X(K)  compatible  with  (A.12).  Also, 
X  satisfies  the  Liapunov  equation 


AX  +XAt  +CCt  =0 


(A.14) 


A  = 


An  ^13 
0  A„ 


.  C  = 


Ci 

C3 


The  pair  {DA)  is  observable.  Therefore,  by  [10,  Corollary  1]  all  eigenvalues  of  A 
in  Re  s  >  0  are  undisturbable.  However,  since  [A, [5  C])  is  controllable,  we  can 
assume  that  {A  +  BK  ,C)  is  a  disturbable  pair  (otherwise  an  arbitrarily  small  change 
in  K,  say  5 K,  will  render  (A  +  B{K  +  5AT),C)  disturbable  [11]).  Therefore. 
(A  ,C  )  is  a  disturbable  pair  and,  thus,  A  is  Hurwitz.  Q.E.D. 


Proof  of  Theorem  3.3:  We  know  from  (2.6)  and  Theorem  4.1  that 


inf  DX{K)Dt  =  limllGJI,2 
K  €  K  Y->°  ' 


(A. 15) 


where 


G/s)  =  Gn(sJCy)  =  D(sf-A-BKyrlC ,  K^Kq+K'1  .  (A.  16) 

Assume  first  that  suj^  }i (K)  =  °°  (i.e.,  (3.1)  is  v-srt  controllable).  Thus,  by  (A.  15) 

and  (4.1),  limllGJI  I  =0  or  equivalently  limG^i)  =  0.  Note  that  Gy{s)  can  be 

"Y — >0  y->0 


rewritten  as 


G^s)  =  D  {si -A  -BKy)~[C 
=  D  {l -{si -A  rxBKy]~l(sI -A  rlc 
=  D  [I+{sI-A  -BKy)~lBKy]{sI -A  )~lC 
D  {si -A  )~lC  +D  {si -A  -BKyrlBKy{sI-A  )~lC 
=  Gn{s  HGS  {s  JCy)T y{s )  . 


(A.17) 


Let 


Gn{s)  = 


a{s) 

d{s ) 


(A. 18a) 
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^  .  77  v  n{s) 

Gs{sJ(y)  =  — - 

^ ) 


(A. 18b) 


I 


& 


7*y(5)  = 


(A. 18c) 


and  note  that  <i y(.s )  =  det(s/  -  A  -  BKy)  is  Hurwitz  for  all  y>0  and 
m^s )  =  Ky  adj  (si  -  A  )C  is  a  polynomial  of  degree  less  than  n.  Write 
n(s)  =  n/(s)nr(s)  where  «/(s)  has  zeroes  only  in  Re  i<0  and  nr(s)  has  zeroes  in 
Re  s>  0  only.  It  can  be  shown  that  Vy  d^s  )-+n,(s  )nr(-s )  as  y— »0  [12]  and 

vy  Ky—tK  as  y— »0  [6].  Thus, 


n(s  )m0(s) 

0  =  G0(s )  =  limG./s )  =  Gn(s  H — — — 

Y-^o  r  n,(.r  )nr(-j)d(5) 

where  m0(s)  =  K  adj(s/  -  A  )C .  Equation  (A.  19)  can  be  rewritten  as 


(A. 19) 


G0(s )  =  Gn  (s )  +  G,  (5 )  r0(5 )  =  0  (A.20) 

where  T0(s )  =  m0(s  )/n,(s  )nr(-s ).  Evaluating  G0(s)  at  a  right  half  plane  zero  of 

Gs  (5  )  gives  G0(z )  =  Gn  (z  )  =  0  (because  «/(z )  nr(-z  )  *  0).  Similarily,  if  z  is  a 
rhp  zero  of  G^s )  of  multiplicity  m ,  then  it  follows  from  (A.20)  that  the  first  m- 1 
derivatives  of  Gn(s)  are  zero  at  z,  i.e.,  G„(s)  has  also  zero  of  at  least  multiplicity 
m  at  z .  This  completes  the  proof  of  the  necessity  part  of  the  theorem. 

Sufficiency:  Consider  a  controller  u  =  F  (s  )y ,  where  F  is  a  proper  rational 
function.  Furthermore,  assume  the  matrix  A  is  Hurwitz  (otherwise,  apply  a  stabilizing 
prefeedback  u0  =  KqX  ).  A  simple  calculation  shows  that  the  precision  of  aiming  of 
(3.1)  with  this  control  is 


(min(q  ,b  )r 

211 GF  II 22 


(A.21) 


i 


i 

e 


V 

V 


> 


a 


y 

,v 

**** 


where 

Gf{s)  =  (1  +  Gs(s)F(s))~lGn(s)  .  (A.22) 

We  will  construct  a  family  of  controllers  {/ra(s)|  which  internally  stabilize  (3.1)  and 

such  that  |i(4//'a)— as  cc— »°°.  Also,  it  follows  from  the  theory  of  optimal  control 
that 


inf  IIGrll->>  inf  lIGt'll-) 

F  KeK  ~ 

stabilizing 

where 


Gk(s)  =  D(sI  -  A  -  BK)'XC  . 

Thus,  since  lim  IIG/r  ll2  =  0  we  have  inf  IIG^  II 2  =  0,  i.e.,  (3.1)  is  y-srt  controllable. 

GC — K>°  K  €  K 

A  controller  F  (s )  internally  stabilizes  (3.1)  if  GF(s)  and  the  noise-to-output  transfer 
function 


Gp(s  )  =  F(s)(l  +  Gs(s)F(s))~lG„(s) 
are  stable.  Select  a  proper  controller 


(A.23) 


Fa(s)  =  Gs  \s) 


a* 


(s+a)k  -  ak 


(A. 24) 


where  k  >  deg[rf(5  )J  -  deg[n  (5 )]  and  a  >  0.  With  this  control  (A.22)  and  (A.23) 
become 


Gf(s)  =  Ga(s)  =  Gn(s) 


(s+a)k  -  ak 


( s+a ) 


GF(s)  =  Ga(s)  =  Gn(s  )G~l(s ) 


a 


(A.25) 


(S+OL)k 

By  assumption  G„  (s )  is  stable,  thus  Ga{s )  is  stable.  Furthermore,  since  G„(s)  has 


zeros  at  all  the  rhp  zeroes  of  Gs(s )  it  follows  that  Ga(s)  is  stable.  Thus,  Fa(s)  is  a 


t 
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stabilizing  controller  tor  (3.1). 


Next  note  that 


o„0'a»  1 2<  I  1 3 1‘  -  -r-  I 

J  0+0. 


<2  Gn(j  o) 


II Gn  ll2  <  ~  . 


Therefore,  by  the  dominated  convergence  theorem  [13] 


lim  IIGall22 

a— too 


II  lim  Gall  2  =  0  , 

a— >®o 


i.e..  (i(vP/’a)— as  a— >°°  . 


Q.E.D. 


Proof  of  Theorem  3.4:  We  will  show  that  G-^s)  given  by  (A.  16)  converges  to 


G0(5 )  as  y~+0. 


From  (A.  17)  and  (A.  18)  we  have 


Gp)  = 


a  ( s  )d^s )  +  n(s  )m^s ) 


7  d(.s)d^s) 

Also,  we  know  that  d^s)  is  the  denominator  polynomial  of  G^s),  thus  d(s)  divides 


a  ( s  )d^s )  +  n  (5  )m^s )  for  all  y  >  0.  From  the  proof  of  Theorem  3.3  we  have 


G0(s)  = 


a(s)nr(-s)  +  rtr(s)m0(s) 


d(s  )nr(-s) 


Thus,  a  (s  )nr(-s  )  +  nr(s  )m0(s )  =  q{s)d(s)  where  q  (s )  is  some  polynomial.  Further¬ 


more,  since  the  degrees  of  a  (s )  and  m0(s)  are  less  than  n  and  nr(s)  has  degree  /  it 


follows  that  q  ( s  )  has  degree  less  than  / . 


Note  that  G0(s)  satisfies,  at  each  nonminimum  phase  zero  of  Gs(s)  of  multipli- 


citv  m  .  the  constraints 


-71  G^s) 

ds 


GAs) 


(A. 26) 


Therefore, 


G0{s )  = 


q  is  )d  {s )  _  q{s  ) 
d ( s  )nr (-5 )  nr (-s  ) 


(A. 27) 


and  q(s)  is  uniquely  determined  by  (A. 26) 


Q.E.D. 


Proof  of  Theorem  3.5:  By  assumption,  the  nonminimum  phase  zeroes  of  Gs(s) 
are  distinct.  Therefore,  we  can  rewrite  G0(s)  as 

1  'i 

G0(s  )  =  £  —d—  (A. 28) 

;=i  zj  +  5 

where  tj ,  j  =  1,  .  .  .  ,  /  are  some  constants.  At  each  zt  we  have  (from  (3.7)) 

Go(z«)=X  - J~  =Gn(Zi)  =  gi  (A.29) 

;=i  z«  +  zj 

Thus,  (A.29)  gives  /  equations  which  can  be  written  in  matrix  notation  as 


Zt=g  , 

where  tT  =  (t ...  ,t,)  and  Z  and  g  are  defined  as  in  Section  3. 


(A.30) 


Next  we  calculate  1 1 0  0 1 1 2  . 


00 

IG0II22  =  7-  J  I G 0(j to) 1 2d to 


00  , 

— i  f  £— ii 

2k  L  h  Z:  + 


1  t. 


j  ^  ~  rf 

i  j=l  Zj  +J co  ,=1 


f  *  i.n,' f  '  *3  3  1 

.  ,v  y;  v  Vv  y ,  v,  *-.* 


LfV 

Va.t  v 


-i.  Cj  +  JM)  -  ;0D) 


=  y  —  f  — 

^  Ini  J  I— 


tJt' 


ds 


i?=  i  2kJ  (Tj  +s){=l  -s) 

Using  the  calculus  of  residues  to  evaluate  the  integrals  appearing  in  (A.31)  gives 


(A.3 1 ) 


Thus, 


I  := 


-jc 


(r  ■  +s)  -  s ) 


ds  =  2k j 


tj  t, i 


z  +  z 

l  * J 


(A.32) 


I1G0II22=  £  =tHZt  .  (A.33) 

'  i  z<  +  zj 

Substituting,  r  =  Z~lg  from  (A. 30)  (note  that  Z  is  an  invertible  Hermitian  matrix) 
gives 


1 1  CJqI  *  2  =  8H  Z~lg 


(A.34) 


and  (3.8)  follows  from  (A.34)  and  (3.5). 
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